DOCUMENT RESUME 



ED 309 013 



RC 017 139 



AUTHOR 
TITLE 



PUB DATE 
NOTE 

PUB TYPE 



Morehouse r Diane L* 

Evaluating Interactive Television: Methods, Findings 
and Issues, Analysis Based on Evaluation of 
Minnesota's Technology Demonstration Program 
1983-1987- 
3 Aug 87 

5p,f Paper presented at the Annual Conference on 
Teaching at a Distance (3rd, August 3-6, 1987), 
Reports - Evaluative/Feasibility (142) — 
Speeches/Conference Papers (150) 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



MFOl/PCOl Plus Postage, 

^Educational Technology; Elementary Secondary 
Education; ^Pro^ram Effectiveness; Program 
Evaluation; *Rural Education; Student Attitudes; 
Teacher Attitudes 

^Interactive Television; ^Minnesota 



ABSTRACT 

Tliis study evaluates interactive television (ITV) 
demonstration projects placed in Minnesota schools to minimize 
educational inequities between small/ large, urban, and suburban 
districts. The basic data gathered for the first evaluation included 
exploratory interviews, document reviews, and case studies. The study 
found significant implementation delays caused by technical planning, 
negotiations of inter-district and inter-agency agreements, 
fundraising, and other factors. Student achievement analyses showed 
no consistent statistically significant difference in test scores. 
The paper concludes that the television medium and delivery of course 
content had no significant impact on student achievement levels, A 
great deal of interaction between students and teachers during the 
televised deliveries was observed, and students expressed very 
favorable attitudes toward the ITV classes. Teachers also expressed 
generally favorable attitudes about the technology, although they 
offered caveats involving participation and preparation. The 
implementation of ITV systems affects school districts in at least 
three ways: (1) it requires and promotes cooperation among districts; 
(2) it permits districts to offer an enlarged curriculum; and (3) it 
provides opportunities for expanded community and adult education, 
Minnesota's demonstration program has allowed, at least in the short 
term, the continued independent survival of a number of school 
districts that would otherwise have been forced to consolidate their 
programs* (TES) 
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bhiil UUPY AVAILABLE 



For reasons v^ll knoun by nsost educators ard. state policyiiHkers, snail niidl sJiool dL&'uicLy have 
been searching for alternatives which wold penrdt greater parity with larger urban and suburban 
districts. In the late 197Qs and early 198Qs, scrae began to explore the use of eiergent television 
technologies which could pemrLt curriculim expansion, without the static, '^lldng hsocf * limtations 
of previous uses of xnstructiorHl television. 

In 1983, the Minnesota Legislature authorized a variety of categorical aids, including funding 
for Technology Dsmonstration Projects, ainEd at increasing uses of coijxiters, television and other 
technologies. The Efemonstration Ftojects were intended to serve as nrxiels of the uses of technology 
tor mstructim and instructional nanageoEnt. Ihe fundanental underlying presuiption was that the use 
of television and other technologies could increase the availability of educational opportunities, 
nxxienuze curricula, and niininiize the inequities between small, outstate and large, urban and 
suburban districts, thereby obviating the need for politically unpopular pairing cr consolidation. 

A total of nineteen TBS projects received state support betvseen 1^ and 1987, ten of \ihich were 
dennnstrations of the use of interactive television (IN). 

Ihe irv dennnstrations enployed various technologies, ranging fran coaxial cable to Fiber Optics 
and several broadcast options. Involving 58 school districts in consortia of various sizes, as well 
as post-secc«idary institutions and businesses, the sites ultijiBtely entailed expenditures of $5J 
million. 

The evaluaticHi model can be characterized as decision-referenced, '^ine^erie^' and 'Veality- 
baseA" At each of several stages during two biennial funding cycles, the process was designed to 
provide answers to decision-^iakers' questions, as appropriate to the real progress and actual 
iflplenentation of distance teaching/learning technology. At the conclusion of each stage, nost of 
lAich comprised no more than four months, oral and wri.tten reports were generated and circulated 
widely* Following each successive report, evaluative questions w^e refined, new questions posed 
and additional data gathering initated. 
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Also introduced kis an expanded cor>oept of neta-evaluatioa A consultant vos retained to provide 
substantive design assistance and ongoing fomative coirnent, to provide an independent assessriEnt of 
the program, and a critical review of the evaluatioi consistent with tte Joint Connattee Standards 
for Evaluati(Mi. 

Exploratory interviews, docuraent reviews and Case studies conprised the basic data gathering 
techniques of the first evaluatioi and program funding iJiases, Daring the second bierniim, bath 
qualitative and quantitative msasures uere erployed at two levels: irxlividual project evaluation and 
data gathering i.esponsi.ve to projected program wide outcoiEa 

IiBpleDHntatioa Technj.cal and essential educational planning, negotiation of sonetiiiES coiplex 
jnter-district agreansnts and cooperative agreements with cable franchise holders, utilities, 
broadcast entities and the R73, fundraising and other factors iJipDsed significant ixcplensntaticxi 
delaya The experience of thsse sites Mxild suggest that two to three years is to be anticipated. 

Studait Achievement. A variety of analyses and testing procedures caqHred student achievement 
in ITV courses with achievement in the same courses delivered traditionally. No consistent, 
statistically significant difference was evident in any of the nearly or^ thousarxl individual grades 
and test scores so analyzed. \!e concluded that the medium of televisicai and tw>or raulti-way delivery 
of course coitent had no significant iiqjact on levels of achievement. 

Classrocm Interacticn. Extensive observational methods revealed a great deal of interactioi 
between students and teachers in these televised deliveries. Ccxisistait with the hi^ representation 
of foreign language classes, mDst was taxcHTomlcally "low-level." Itere vsere no differences in levels 
of interaction in live (teacher present) and remote sites. Teachers' basic iiiteraction levels 
appeared to be unaffected by the msdiim Ihsre \fas, however, enonnous variability among individual 
teachers; patterns vMch remained consistait vtether the teacher was in a distaoce or conventional 
setting. 

Student Attitude. Students, following an initial period of adjustment, expressed very favorable 
attitudes tcMard ITV classes, finding them 'ki interesting way to l^ra" They wer^ generally 



canfortable with the raediun, could see and hear tte teacter and each otter, arri talk -/ith the teacter 
as often as they wishal Ihsre vere no evident a*fereix:es in attitude on the part of students 
particifatLng in rarote sites, and those in live or origination sites. 

Teacher At titude, fartjcijating teachers also expressed generally favorable attitudes about this 
technology, although with certain caveats respecting participaticn and preparation, Teacters reported 
nV systems offer several advantages including enlarged program options for students, and ctellenge 
and professional growth opportunities for themselvea Inherent disadvantages wer^ noted, including a 
greater frequency of cheating, lack of personal contact with students, movement and space 
restrictions, occasional technical problems, delays in naterials transfer, problens with the 
logistics of nake-up mik, and conflicting school caloidars and daily schedules. 

Teachers tended to use more visual media, allocate nare time to preparation and greater effort 
to maintain student interest, involvement and interaction. Ingredients essential to the 
participation and satisfactLcai of teachers vers participation in decisioHiBking, adequate inservice, 
practix:e and hands-on e^qDerience with equipment, opportunities for self and peer-K:riticism, and 
ongoing support from principals and project directors 

C^t& Planning and construction costs in the ten Demonstration sites ranged fran a low of 
$131,400 (for a cable system) to a hi^ of $1,082,805 (for an TIFS system). Median caistructicxi costs 
were $589,253. Annualized operating costs ranged from a low of $36,500 to a high of !61,177,617; the 
nedian was ."$40,974, 

Qrgani2aticm l Ctenges. Ib^lementation of HV affects school districts in at least three ways: 
one, it requires and promotes cooperaticxi anong districts; two, it permits districts to offer an 
enlarged curriculun; and three, it provides opportunities for expanded connonity and adult education. 
Minnesof^'s program has allowed, at least short term, the continued independent survival of a number 
of school districts which otherwise vould have been forced to pair or consolidate prograiB. RrograiB 
virtually force districts to relinqui^ a degree of local autonomy, require coorxiinated strategic 
planning, and the meaningful involvement, preparation and stipport of teactera For districts without 
a clearly artix^dated educational need or in which strategic planning does not occur, we cax:luded 
that nV is an inappropriate and ineffective alternative. 
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